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BOOTSTRAP RANDOM WALKS 


ANDREA COLLEVECCHIO, KAIS HAMZA, AND MENG SHI 


Abstract. Consider a one dimensional simple random walk X = (A„)„>o. We 
form a new simple symmetric random walk Y = (E„)„>o by taking sums of 
products of the increments of X and study the two-dimensional walk {X,Y) = 
{{Xn,Yn))n>o- We show that it is recurrent and when suitably normalised con¬ 
verges to a two-dimensional Brownian motion with independent components; 
this independence occurs despite the functional dependence between the pre- 
limit processes. The process of recycling increments in this way is repeated and 
a multi-dimensional analog of this limit theorem together with a transience re¬ 
sult are obtained. The construction and results are extended to include the case 
where the increments take values in a finite set (not necessarily {—1, -|-1}). 


1. Introduction 

Consider a symmetric simple random walk 

n 

Xn = '^^k, n> 1, and Aq = 0, 

k=l 

where ^ 2 , • • • are independent and identically distribnted random variables with 

P(6 = -i) = P(6 = +i) = t 

It is easy to see that the sequence 

n 

Vn = Yl^k, n> 1, 

k=l 

is made up of independent and identically distributed random variables taking 
values ±1 with equal probability. It immediately follows that 

n 

Yn = '^r]k, n>l and To = 0 

k=l 
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is also a symmetric simple random walk; that is 
(1) {Yn)n>0 = {Xn)n>0. 

We refer to the process of constructing (W)„ from (X„)„ - that is of “recycling” 
the increments of the latter to form those of the former - as bootstrapping. 

While ([1]) is immediately clear, what may be less understood is the behaviour of 
the two-dimensional process Wn = (X„, W). 


It is worth emphasising at this point in time that the hltrations generated by the 
two processes {Xn)n>o and (W)n>o are identical: 


n 

Vn = Y\_^k and 

k=l 


Vn 

Vn-1 




This strong (functional) dependence is however entirely lost at inhnity. More 
precisely, we establish that the process (Wn)n>o suitably normalised converges 
(weakly) to a two-dimensional Brownian motion (with independent components). 
The process of taking partial products and their partial sums can then be iterated 
yielding a higher dimensional version of this result. Again, despite the functional 
dependence between the components of the pre-limit processes, the limiting process 
is a multidimensional Brownian motion (with independent components). 


In this paper, we take a further generalising step, one that drops the requirement 
that Instead, we allow to take values in a hnite set U = 

{uq, Ml,..., Mp_i} C M and propose a general method for dehning rjn and all other 
iterates in such way that all partial-sum processes are identical in distribution to 
{Xn)n- Here again, the strong dependence in the joint process is lost at inhnity 
and the limiting process is a multidimensional Brownian motion (with independent 
components). The functional central limit theorem in this generalised form is 
presented in Section HI 

We also briehy discuss a connection with cellular automata (see Section |3]). 


The pre-limit process Wn in itself is worth looking at and we present some of 
its properties in Section HJ Section [3] deals with the model setup and presents a 
number of basic properties including a rather precise formulation of the iterates, 
of any order. A number of combinatorial proofs are given in Section Hi 


2. Simple two and three-dimensional bootstrap walks 

Let (^n)n>i be a sequence of independent and identically distributed random vari¬ 
ables such that = ±1 with equal probability. Dehne (X„)„, {r]n)n, (Hn)n and 
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(Rn)n as per Section [T] We summarise our observations so far in the following 
proposition. 

Proposition 1. (1) (? 7 n)n >0 = (^n)n> 0 ; 

(2) (W )„>0 = (W)n>o; 

(3) Yn+l = W + and Xn+l = Xn + (-1)^^ r]n+i; 

(4) {Wn)n is a time-inhomegeneous Markov process; 

(5) (W 4 n)n is a time-homegeneous Markov process. 

Remark 2. As the purpose of this paper is to study the joint behaviour of random 
walks that are identical in law and constructed entirely by recycling the increments 
of one of them, the assumption that ^ 1 ,^ 2 , • • • (or for that matter rji,rj 2 ) ■ ■ ■) are 
uniformly distributed (over {—is crucial. Indeed, suppose = 1) = p. 
Then, 

nin = 1) = i(l + { 2 p - 1)") 

which shows that rjn = f,n if and only if p = 1/2. In fact, writing e for (e + l)/2 
whenever e G {—1, +1}, the law of can be written as P(.^„ = e) = p^{l — pY~^ 
and, for any seguence .. ., G {—1, +1}; 

¥{r]i=ei,r]2 = £2,---,Vn = £n) = P(6 = • • • , = ^n-Rn) 

where m = Y2=i ^k-Yk (so = 1). Again, we see that (r]i,... ,r]n) = (6, ■ ■ ■,(,n) if 
and only if p = 1/2. In other words, when p ^ 1/2 the marginal distributions are 
not maintained in the recycled seguence, and the independence is lost. 

Next, we obtain the distribution of Wn and highlight that, unlike the two-dimensional 
simple random wall£|, its support is not square in shape. In fact it has a triangle-like 
shape as shown in Figure [TJ 

Theorem 3. Assume that n, k and I are integers such that \k\ < n, |/| < n and, 
n + k and n + I are even. 

If n — k = 0 mod 4 and \2l\ < n + k, 

( n+l \ / n—l—2 \ 

^By this we mean the process whose components are independent simple random walks. 
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Figure 1. Distribution of W12 (in the black to red spectrum). 

If n — k = 2 mod 4 and |2/+ 2| < n + A;, 

( n+l \ / n—l—2 \ 

j [ n*f2,-2 ) ■ 

In all other cases P(X„ = k,Yn = 1) = 0. 

Of particular interest are the probabilities of return to the origin. 

Corollary 4. (1) P {W,n = 0) = (2^); 

(2) P(lF4n+2 = 0) = 

(3) P(lF2n = 0)~^. 

The recurrence of (hF 4 n)n and therefore that of (hFri)n now follow immediately. 
Theorem 5. {Wn)n is recurrent; it will revisit the origin infinitely often. 

The next natural step is to repeat the process of bootstrapping by forming succes¬ 
sive products. We shall look at this setup in substantial generality in Section [3l 
Here, we limit ourselves to the three-dimensional random walk also 

denoted Wn, where 

n k k j 

Zn = '^Ck, n > 1, Zo = 0 and Cfc = = H 11 

k=l j=l j=li=l 

and ask essentially the same questions we just answered in the two-dimensional 
setting. 

Theorem 6. The following results hold for the three-dimensional bootstrap random 
walk (Wn)n- 
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(1) For any n >2, 



(2) P(W 2 n = 0) = for any a G (1/2,1). 

(3) {Wn)n is transient; it will visit the origin finitely often. 

Remark 7. It immediately follows from the previous result that any multi-dimensional 
random walk whose three-dimensional projection is Wn, is transient. The {K + 1)- 
dimensional random walk introduced in Sectionl^is such an example. 

In summary, two and three-dimensional bootstrap random walks share many of 
the characteristics of simple random walks. The next limit theorem reinforces this 
observation. It states that these random walks appropriately normalised converge, 
as simple random walks do, to independent Brownian motions. 

Theorem 8. Let Wn(t) = t G [0,1]. QRn converges weakly to a three- 

yn 

dimensional Brownian motion (with independent components). 

The proofs of the above statements are given in Section |H 

3. The model setup 

In this section we generalise the previous setting in two directions. First, we allow 
the random variable fn to take values in any hnite set U = {mq, mi, ..., Wp-i} C M. 
Then, we iterate the process of bootstrapping an arbitrary number of times. We 
shall assume that p is a prime number. The case when p is not prime is discussed 
at the end of this section. 

The hrst obstacle we have to overcome stems from the fact that in general, if 
xi,X 2 G U, X 1 X 2 ^ U. An easy way to get over this hurdle is to dehne a map U x 
lA —)■ lA that will replace the usual product. In other words, we dehne an operation 
® on lA. To extend the mapping to higher dimensions while maintaining the 
hexibility afforded by the usual multiplication (associativity and commutativity), 
we assume that {lA, ®) is an Abelian group. 
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We shall write e for the unit element of (W, <8) and u®” for the nth power of 
u eU. Using the Lagrange Theorem that states that the cardinality of a subgroup 
must divide the cardinality of the group, we immediately obtain the following 
results. 

Proposition 9. Let u eU\ {e}. 

(1) p is the smallest positive integer such that = e. 

(2) n®” = n®™ if and only if n = m mod p. 

(3) hi is cyclic; that isU = (u) = {e, n, 


Next we introduce the forward bootstrap operator on the set if of sequences in 

U 

A: il —^ if 

{Xn)n ^ 

and its inverse, the backward bootstrap operator 

A-i : il - 
iyn)n 


it 

0 - 1 ) 




These mappings can be iterated to dehne the operator , for any positive integer 
K. It is then easy to see that if x, = {xn)n £ it and yx,* = A^{x,), 

n 

/C>\ 

yK,n — 

e=i 

for some array ux^e £ {0,1,... ,p — 1}. 

One can more generally dehne the mapping for any integer K. Furthermore, 
for any integers K and J, we have 

Vk,. = A^--^{yj^,). 

In particular, 

(2) yx,. = A^{x,) and A~^{yx,,) = x,. 


Proposition 10. The array vx,n, K E Z, n ^ N*, satisfies the following (defining) 
properties: 

(1) Uq i = 1 and = 0 for n > 2; 

(2) ux,i = 1 for any K; 

(3) Vx+I,n+1 = ^K+i,n + i^x,n+i Hiod p, for any K and any n>l. 
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Figure 2. The array uk/ when p = 2 (left) and p = 7 (right) 


It follows that, for any K and any n > 1, 


^K,n 


fn + K-2\ 

V n-1 ) 


{K + n - 2){K + n - 3)... K 
{n — 1)! 


mod p. 


Proof. Let x, = {xn)n G if, !/• = A(a;,) and yx,* = A^{x,). We deduce (1) and 
(2) from the facts that i/o,« = x, and Xi = yxp = respectively. (3) follows 

from: 


n 



n 

n 

^n-£+l \ 


yK+l,n A (|/»)n 

= 

09rs 

= 0| 

Xk 1 

e.=i 



l=\ 

i=l 

V k=l J 


n n—£+l 

n 

n—k-\-l 

n 



= 00 = 

0 

0 

= 0 

^{l'K,l + -..+l'K,n-k+l) 
^k 


i=l k=l 

fc=i 

£=l 

k=l 



n 






i=i 


□ 


As in the simple random walk setting, we assume that the random variables 
.^ 1 , .^ 2 , • • • are independent and have a common uniform distribution on U: 

f’{^n = Ui) = -, 0<i<p-l. 

p 
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Further, we define recursively rjK.n as 

n n 

Vl,n = ii, VK,n = VK-1,£, 

£=\ £=1 

and write for simplicity for 

Define (-Fn)n>i to be the natural filtration generated by the sequence (^n)n>i- From 
02]) we get that, for any JF, 

^n ' ' ' 1 ^n) ■ ■ ■ ) VK,n)- 

Proposition 11. For any given K, {riK,n)n o,nd (^n)n have the same distribution. 
In particular, rjK^n is uniform overU and is independent of Tn-i- 

Proof. It is, of course, sufficient to prove the result for K = 1, which we establish 
with the aid of the backward bootstrap operator: 

P ivi = 2/1, V 2 = y 2 ,---,Vn = Vn) 

□ 

Remark 12. Note that not only do we have = (^n)n but for any sequence 

of integers 7 ^ 0 mod p, = (^n)n and therefore ((S)Li = 

('Cn)n>o- Indeed, let yi,...,yn G U. Fix u & lA, u ^ e. Then we can write 
yi,... ,yn as ,..., and using Lemma m we have 

= P = -U^bl+^ip) _ y®(jn+lnp)^ 

— p _ y®(kimi) ^®mn _ y®{knmn)^ 

= = = ( 1 /p)". 

Lemma 13. For any integer m 7 ^ 0 mod p and 0 < j < p, there exists a pair of 
integers {k,£) such that km = j + £p. 

Proof. Since p is prime, gcd(m,p) = 1. By Bezout’s identity, there exist integers 
a and b such that am + pb = 1. Then with k = ja and i = —jb, we have 
km = i + £p. □ 

The next proposition looks at the dependence structure of the columns in the px,n 
array. It relies on the following lemma. 
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Lemma 14. Fix xi, ..., Xn-i and Xn+K-, Ui, ■ ■ ■ ,yK all in lA. The system of equa¬ 
tions in Xn, • • • , Xn+K-l 

n-\-K 

(3) 0dtO+i=». *: = !.■■■.-ff 

i=l 

has a unique solution. 

Proof. Write yk,n = <3)^=1 ^n-£+i equivalent to 

yk,n+K yki h 1 , . . . , K. 

With the aid of the following representation we show that a solution exists and is 
unique. While we do not give an explicit expression for this solution, the mechanism 
to obtain it is clear. Starting from the light blue (hrst row) and light red (last 
column) cells we construct the remainder of the array. The colours are merely an 
indication of the steps in the construction and do not represent particular values. 



Figure 3. The array yk/ for 0 < k < K and 1 < i < n K. 


Using the fact that any two cells in a triangular array of the type 



X 

y 

z 


uniquely determine the third, and the fact that the hrst column is identical to 
its top cell {yk^i = |/o,i = Xi), we see that we can work our way in a unique 
fashion from the the vector (i/o,n+K, • • •, yK,n+K) (the light red cells on the right¬ 
most column) to {yK,n, • • •, yo,n+K) and other intermediate values (the cells forming 
the red triangular array), and from [xi,... ,Xn-i) (the light blue cells on the hrst 
row) to (|/o,n-i, • • •, yK,n-i) and other intermediate values (the rectangular array 
made up of blue cells and in particular the right-most column within it). Combining 
the red and blue cells, we can then work our way up through the yellow cells and 
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arrive to a unique set of values for (xn, ■ ■ ■ ,Xn+K-i) (the green cells on the top 
row). □ 


Remark 15. A by-product of the the above lemma is an interesting observation 
on the square matrix Indeed, ([3]) can be rewritten 


X 


'Sll'k,K+l 

n 


( 8 ) X 


n+1 


•^n+K-1 -^n+K 


n-\-K 



^n+K-i+V 


£=K+2 


k 


.K, 


which has a unique solution if and only if the matrix (r'fc,£+i)i<fc,£<A is non-sinqular. 
As a result we get the that, for any K, universally in p, 


^1,2 ^1,3 ■ ■ ■ ^1,A+1 

J^2,2 ^2,3 • • • ^2,A+1 ^ ^ 

l^K,2 ^K,3 ■ ■ ■ ^K,K+1 

Choosing p large enough shows the result to be true for replaced with the bino¬ 
mial coefficient . 

Proposition 16. The vector {rio,n+K, ■ ■ ■ ,VK,n+K) is uniform over and is 

independent of Tn-i- In particular, the random variables rjo^n+K, ■ ■ ■ nre 

independent. 


Proof. Fix xi,..., Xn-i and Xn+K, yi,---,yK all in U. Using the above lemma, we 
immediately get that 


lP(l?0,n+A — Xn+K, Vpn+K — l/l, • • • , VK^n+K 


i^l/pY+K 

( 1 /p)"-' 




X\, • • • , ^n—1 Xn—l) 


We conclude the proof by observing that the above conditional probability is in¬ 
dependent of the choices of Xi,..., x„_i and Xn+K,yi, ■ ■ ■, yK- D 


The functional central limit theorem given in Section 0] relies on a detailed anal¬ 
ysis of the relationship between the various riK,nS. Being a product of powers of 

^1) • • • ) ^ni 

n 

1=1 

we need to identify those that are multiples of p. As such, the corresponding fkA 
are “switched off” making them independent of 'r]K,n- The following results address 
these very issues. 






Bootstrap Random Walks 


11 


To understand the structure of we make use of the following theorem (see [2], 
p229). Recall that the base p expansion of n is n = akP^ + ... + aip + where 
do,..., afc G {0,1,... ,p — 1} are the base p digits of n. 

Theorem 17. [Lucas] A binomial coefficient is divisible by a prime p if and 
only if at least one of the base p digits of m is greater than the corresponding digit 
ofn. 

The following proposition is essential to our analysis. Its proof can be found in the 
appendix. 

Proposition 18. The following properties hold for VK,n- 

(1) for K = p^ and 1 < n <p^, then h'K,n = 0; 

(2) for n = p^ and 1 < K < p^, then UK,n = 0; 

(3) for n = p^ + 1 and 1 < K < p^, then h'K,n = 1 mod p; 

(4) forl< K < p^, UK,pi-K+i 7 ^ 0 mod p. 

Corollary 19. Let ujk = min{n > 2 : i'K,n 7 ^ 0 mod p}. Then ujq = +oo and, 
if p^ is the smallest power of p greater than or egual to a positive integer K, then 
< p^ — K + 1. 


The hnal ingredient in the model setup is to dehne the random walks them¬ 
selves: 

n 

(5) YK,n = 'Yh with Yka = 0, 

i=l 

where ^ represents the usual sum in M and K G Z. We shall maintain the notation 
Xn for Yo^n- 

From the equality in law of the sequences {pK,n)n, we immediately deduce that, for 
any given K, {YK,n)n is a random walk identical in law to (W)n- 

As our aim is to prove a central limit theorem for the {K + l)-dimensional random 
wall@ Wn = (ho,n, • • •, YK,n), & uecessary step of which is the removal of its drift, 
we can assume without loss of generality that 

= 0 . 

When this is coupled with the requirement that fn must have a uniform distribution 
(to guarantee that the distribution of (W)n is preserved after bootstrapping), we 

^Here again we abuse notations by referring to this process as Wn- 
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obtain the following condition on the values in lA: 

(6) Mo + Ml H - h Mp_i = 0. 

The second moment of S,n plays an important role. We denote it by cx^: 

(7) = -(Mq + M^ +-h 

Proposition 20. Let K and J he integers and, m and n he positive integers. 

(1) If m^n, then E[r7x,mhJ,n] = 0. 

(2) If m = n and K = J, then ^[riK,mVJ,n\ = <7^- 

(3) If K J and m = n < uj\k-j\, then E[r]K,mVJ,n\ = 

(4) If K ^ J and m = n> uj\k-j\, then E[r]K,mVJ,n] = 0. 

It follows that, for m < n, 

( 5 ) E[YK,myj,n] = mm{m,ujiK-j\ - 


Proof. The first two statements follow from the identity in law: 


{VK,m,VJ,n) = ((A^ '^(W,.))m,hJ,n) = ((A^ = {VK-J,m,^n), 

where rjj^, = {rjj^n)n and f, = (^n)n- To show the next two statements we proceed 
as follows. Suppose K > J. We write 




E 


E 


I 




^m—£+l 


1=2 


^m—£+l 


e=2 


then we observe that, for m > ojk-j (so that at least one r'K-j,i 7^ 0 mod p) and 
any u & U, u ® (S )^2 im-t+Y uniformly distributed over U. Of course, in the 
case m < ujr-j, ^VK,mr]J,m] = E[^^] = aT 


Suppose, for the last statement, that m <n, then in view of (1), 

m n m 

EE HvK,iVj,j] =y^,^VK,iVj,i]- 

i=l j=l i=l 

The result follows by application of (2), (3) and (4). □ 


We end this section with 2 remarks. 









Bootstrap Random Walks 


13 


Remark 21. When p is not prime, one ean alter the distribution of ^ by adding 
sufficiently many zeroes to make the number of possible values prime. On the one 
hand, these zeroes will be seen differently by the operation (g) yielding a cyclic group, 
on the other hand, their only impact on the the bootstrapped random walks is to 
slow down their evolutions. The resulting random walk is simply a “lazy” version 
of the original one. 

Remark 22. In the case p = 2 and when one focuses on the array pK,n 
the increments and not the random walks themselves), then the setup appears as 
an “infinite” memory cellular automaton, which can be reduced to a regular one 
(CA60) by performing a “sliding” of the columns (see Figure\^. The sole reason 



Figure 4. The array pK,f: (in its original form on the left) becomes 
after “sliding” (right) a cellular automaton 60 [p = 2). 

for this observation is for completeness as our focus is on the random walks and 
this connection has no bearing on our results or thinking. 



4. A FUNCTIONAL CENTRAL LIMIT THEOREM 


It is well known that A„(f) = — ^X\nt\ and more generally ^Knit) = — \nt\ 

Oyjn ’ Oyjn 

converge weakly to a Brownian motion [t G [0,1]). The focus of this section is the 

{K + l)-dimensional process Wn{t) = (i5o,n(t),..., 2)-R',n(t)), t G [0,1]. 


Theorem 23. For any positive integer K, 2ir„ converges weakly to a {K + 1)- 
dimensional Brownian motion (with independent components). 


Proof. Using the Cramer-Wold device (see for example Billingsley m) we reduce 
this multi-dimensional problem to a one-dimensional one. To this end we £x a 
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normalised vector (oq, ..., ax) G ~ focus on the sequence 

of processes 


K 


K 


\nt\ K 


^ ^ ^k^k,nify j — % ^ (^k^K, [nt] i — ^ ^ ^ ^ /— 

fc=0 '' k=0 ^ l=l k=Q ^ 




where 


K 


Sn = '^Ri and R(, = '^ afc%,£. 


e=i 


k=0 


By Proposition [20l the random variables Rn are clearly uncorrelated 


K 


k,£=0 

and we have 

K K K k-l 

ml] = E aka0(r]k,n'niA = ^ al + 2o‘^ EE ttkttil 

k,e=0 k=0 k=l 1=0 

which, for n > maxi<k<K ^k, reduces to 

El-ffSl = 


n<u)k-e^ 


We deduce that Sn is a martingale with respect to the hltration Rn and 

n 

(8) al = E|SJ] = ^ E[B|] = m + C, 

£=l 

where C is a constant that only depends on K and Qq, ... ,aK and not on n. 


Next we introduce an intermediary process 97t„ and use a result of Scott [3] to 
show that it approaches a Brownian motion (weakly). For t G [0,1], we set 
Tln{t) = Sk/sn whenever k is such that si < tsl < sl^^. Then, since Sn has 
bounded increments, to establish the weak convergence of 97t„ to a standard Brow- 


1 


n 


nian motion, it is sufficient to show that — 

1=1 


1 (see |3]). 


In fact we shall prove a stronger result in which the convergence is almost sure. By 
Proposition [12] we know that, for any k G {1,..., iP}, {Rk+nK)n are independent 
random variables. If we now let Vk^n = R^j^n(K+i) ~ ^\.^k+n{K+i)\ observe 
that, since the RnS are bounded random variables, so are the Vk^nS. It follows 


that 


EK 


k,n\ 




< +CX 0 from which we deduce (see for example i Pll8) that 


n 
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n—1 


n 


^{Rl+e(K+i) - ^Rl+e{K+i)]) ^ 0 and consequently that 


e=o 


n—1 


1 p2 1 

2^ ^k+e{K+l) ^ 


£=0 


Here we have used the facts that ~ a^n and for n large enough. 

Summing over fcG{l,...,R + l} yields 


n{K+l) ^2 - ^ 


E « 


(A-+1)4 1 


n—1 


^n{K+l) ^=1 


K 

*n(K+l) 




■k+l{K+l) 


1 . 


k=l £=0 


It now follows that 9Jt„ converges weakly to a Brownian motion and so does 
(sn/(o‘\/n))9Itn- 


The hnal step is to establish that the processes and (sn/((T-y/n))0Jt„ are asymp¬ 
totically equivalent. More specihcally, we show that 


(9) 


lim sup 6„(i)- 

rn-oojg[oi] (y\/n 


0 . 


Fix t G [0,1]. Using ([8]) we get that, if si < tsl < sIj_^, then nt — Ci — 1 < k < 
nt — Cl, for some constant Ci. Using the boundedness of the increments of S'„, we 
deduce that, for some positive constant C 2 , 


Finally, 


&n{t) 


— C 2 2 Sk 2 Sint] + C2- 


CT-v/n 



S\nt\ 

Sk 


a^/n 



1/ 


from which we deduce that ©„ converges weakly to a standard Brownian motion 
and therefore that 2IJ„ converges weakly to a (iF-l-l)-dimensional Brownian motion. 

□ 


5. Combinatorial proofs 

Proof of Theorem [Si The event {Xn = k} is characterised by the number of 
(—l)’s amongst {^ 1 ,... being equal to Call this quantity To further 
require that W = ^ the (+l)’s and the (—l)’s must be arranged in a specihc order 
we describe in the next few lines. 

The approach is to think of the (—l)’s as dehning bins in which the (+l)’s must 
be placed in an appropriate way. Each bin will have a number (possibly zero) of 
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(+l)’s followed by one (—1). At the end of this line of bins, we allow one further 
bin that may only contain (+l)’s (or may be empty) - see Figure [5l 

Bin 1 Bin 2 Bin 3 ''' Bin Bin n^ + l 

Figure 5. The bins representation 

To decide on the value of all we need is to identify the bin in which 

falls and more precisely its evenness. Indeed, if falls in an even bin, then 

r]m-i = — 1, while if it falls in an odd bin, then = +1- The value of r]m is 

simply 

Let us now denote by at the number of (+1) in Bin 2i — l (odd bin) and by f3i the 
number of (+1) in Bin 2i (even bin). Consider hrst the case even. Then 


nfc/2 nfc/2 nfc/2+1 nfe/2 

^ 1 ) ^ (1 (^i) ^ ^ ^ ^ Pi ^ Pi 

i=l 2=1 2=1 2=1 

where a is the total number of (+l)’s in odd bins and (3 the total number of (+l)’s 
in even bins. The requirement that Yn = I now reduces to the restriction that 
a — I3 = 1. Since the total number of (+l)’s (in all bins) is n — n^, we deduce 
that 

n — rih + l n — Hh — I 

a = - - -and /3 =- - -. 

2 2 

In summary, = k and Yn = I ii and only if, amongst {^i,..., there are 
(+l)’s with placed in odd bins and placed in even bins. Therefore, 

the number of sequences that lead to = k and Yn = I equals the number of 
ways of placing ^-‘^^+1 j^to ^ +1 (odd) bins and jt± (^even) 

bins: 

( n+l \ / n-l-2 \ /1 \ 

j j (2) • 

The case rik odd is dealt with in an identical way. 

Proof of Theorem [G]. (1) Probability of return to the origin. 

Recall that Wn = (Fo,n, y 2 ,n) = (hTi_„, Fq,?!, Ti,n)- Our first task will be to 
obtain the probability of return to the origin of the process (ICgn, '^i,n) iu 4n 
steps. 

We know from Theorem [3] that (To, 4 n; ^lAn) returns to the origin if and only if 
there are exactly 2n (—l)’s and 2n (+l)’s equally split between odd and even bins. 
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To add the constraint that R-i 4 „ eqnals zero, we introdnce the concept of a sign 
change. We shall say that index i {i > 1) represents a sign change if = —1 

(eo = 1). 

Now the event = 0} coincides with the event 



For the hrst bin, no matter whether or not it is empty, there is one sign change. 
This is because the first —1 in the sequence produces a sign change as we suppose 
that .^0 = 1- From the second bin to the (2n)th bin, each non-empty bin translates 
into exactly 2 sign changes. The last bin produces one sign change if it is non¬ 
empty and no sign change otherwise. We see that, in order for y_i, 4 n to equal 0, 
the last bin must be non-empty (i.e. = 1) and exactly n — 1 out of bins 2 to 

2n must be non-empty. 

Next we set ^in+i = — 1 and place all digits on a circle thus forming 2n + 1 bins. 
The extra bin is the one that ends with S, 4 ,n+i (which could also be thought of as 
.^_i) and is non-empty as = 1- 

1 -1 I I 1 _^1_^1_^ I_-1| | ••• 

2n + l 1 2 3 ’ '' 2n 2?t, -|-1 

Figure 6. The bins representation on a circle 

With the additional digits, .^o = 1 and i^n+i = —1, represented in red in Figure [HI 
two additional sign changes are added to the original 2n. 

The scheme now reduces to placing exactly 2n -|- 1 balls into the bins with the 
following constraints: 

• bins 1 and 2n -|- 1 are non-empty (they each have at least one (+1)); 

• of the remaining 2 ?t, — 1 (-(-l)’s, n — 1 are placed in odd bins and n in even 
bins; 

• the number of non-empty bins equals exactly n -|- 1 (any non-empty bin 
translates into two sign changes). 

The number of non-empty odd bins can be anything from 0 (all n — 1 (+l)’s are 
in bins 1 and 2n -|- 1) to a maximum of n — 2. In fact, it is not possible to have 
n — 1 non-empty odd bins as that would imply that all even bins are empty. 

Let us now consider the case of k non-empty odd bins. These must be selected out 
of n — 1 odd bins. The remaining n — l — k non-empty even bins must be selected 
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out of n even bins. Having selected the non-empty bins, we next count the number 
of ways to place n-l-1 (+l)’s into the k + 2 odd bins and n (+l)’s into the n — l — k 
even bins (in such a way that all bins are non-empty). Taking into account these 
combinatorial observations and summing over the number of non-empty odd bins, 
we get that the probability of the event of interest equals 



The case of return to the origin after An + 2 steps is obtained in an identical 
way. 


(2) Order of P(lT 2 n = 0). 


Fix a e (1/2,1) and let a„ = \n/2 — n"J, = [n/2 -|- ?7,“J and 


^n.k 


/u — k\ 

{n — k){n — k — 1) 

/n — k\‘^ 1 

V n / 

^ n{k + 1) 

Kk + l) \ 


SO that 


2'‘"P(W'4„ = 0) = > C„,4 + 


E 

k<an 


E - 

k£{an,bn) 


-'Ti^k 


E 

k^bn 


'Ti^k 


Ti -|- r2 -|- Ts. 


In the sequel, we obtain bounds for each of these three terms. We use Oj to denote 
various positive constants. 
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Using Stirling’s approximation and the fact that the binomial coefficients are in¬ 
creasing for k < (n — l)/2, we get that 


hi < 


k<a 

< C2n 


< 


< Uin^ 


n 


n 


{n — ttn)"' 

4 


C^n 


n/2 - {nl2 -f 

n"(n/2-n“)"“ x4 


1 


< U3n®2^'^exp 


1 — 477,2““^/ Vn/2-l-n 


2^^ (njl — 

2n"-i 


4^2q:-2 

8^2a-l 


1 - 


1/2 n"-i 

16n2“-i 


4n“ 


.1 —4n2"“2 1-|-2?7,““^ 

< U3n®2^” exp ^ — U4n^““^ j 


In the same way, we have 

Ta < U 5 n® 2 ^" exp . 

Finally we have 

<Cs2^^n^-\ 

(3) Transience. As is summable (a — 2 < —1), = 0) < -|-cxo and 

(Wn)n is transient. 


Proof of Proposition 1181 (1) For K = and 1 < n < then = 0. 

Let n — 1 = ai_ip^~^ -|- ... -|- oip -|- Oo) where 0 < Oj < p for 0 < i — 1, be the 

base p expansion of n — 1. Then the base p expansion of n -f- iF — 2 is 

77 + iF-2=p^-f Q!£_ip^“^ + ... + {aj - l)pP -f (p - 1) y^p' 

i=0 

where j is the hrst index such that aj Y 0 (i-^- *^0 = • • • = ctj-i = 0 

aj > 1 ). 
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Since digit j in the base p expansion of n — 1 (i.e. aj) is greater than digit j in 
the base p expansion of n + K — 2 (i.e. aj — 1), we obtain the desired result by 
application of Lucas Theorem [T71 

(2) For n = p^ and I < K < p^, then i/K,n = 0. 

This is an immediate consequence of the symmetry of the array i'K,n- 

(3) For n = p^ + 1 and 1 < K < p^, then i>K,n = 1 mod p. 

Using (2) we can write 

^K,p^+i = + ^K-iy+i = ^K-iy+i niod p 

= ^K-iy + ^K-2y+i = ^K-2y+i p 

= ■■■ = V2y + ^ly+i = ^ly+i = 1 mod p. 


(4) For I < K < p^, ^xy-K+i 7^ 0 mod p. 

When K = p^y-K+i = = 1 7 ^ 0. Let us assume that 1 < iF < p^. We 

write n = p^ — K + 1 and K = (3i-ip^~^ + ... + f3ip + (3o for the base p expansion 
of K. Then the base p expansion of n — 1 is 


n—1 = p^—K 


(p - 1 - Pi-i)p‘^ ^ + ... + (p - 1 - /5i)p + (p - /do) 0 < Po <p 
(p - 1 - I3i-i)p^-^ + ... + (p - 1 - Pj)jP /3o = 0 


where j is the hrst index such that Pj 7 ^ 0 , i.e. Po = ■ ■ ■ = /3j-i = 0 , [3j 7 ^ 0 . 
On the other hand, the base p expansion of n + iF — 2 is: 

n + iF — 2 = p^ — l = (p— l)p^“^ + ... + (p — l)p + (p — 1). 


Again, by application of Lucas Theorem [TTl PK,n is not divisible by p. 
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